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NOISE REDUCTION FOR TELECONFERENCING WITHIN AN 
INTERACTIVE TELEVISION SYSTEM 

Inventor: 

5 

Charles R. Broadus, Paul G. Allen, Douglas A. Miller 

BACKGROUND OF THE INVENTION 

RELATED APPLICATIONS 
10 The present application is a continuation-in-part of U.S. Patent 

Application Serial No. 09/863,053, filed May 22, 2001, for "Contact List for a Hybrid 
Communicator/Remote Control," with inventors Paul G. Allen, James A. Billmaier, 
and Robert E. Novak, which is hereby incorporated by reference in its entirety. 

FIELD OF THE INVENTION 

15 The present invention relates generally to the field of interactive 

television systems. More specifically, the present invention relates to systems and 
methods for providing noise reduction for teleconferencing within an interactive 
television system. 

DESCRIPTION OF RELATED BACKGROUND ART 

20 Television watching is an immensely popular pastime throughout the 

world. Indeed, one or more televisions can be found In virtually every residence in 
the United States and many foreign countries. The television viewing area is often 
the focal point of the home, a location at which family members spend a 
considerable amount of time, even when not watching television. 
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For many, the television viewing experience is enhanced by watching 
television programs with other people. Thus, typical residences are equipped with 
numerous seats in front of a television to accommodate several family members and 
friends. Certain television programs are more frequently viewed in the company of 
5 others. For example, sporting events, television premieres, political debates, and 
other significant television broadcasts are typically viewed by groups of people. 

Often it Is inconvenient for viewers to be physically present in the same 
room due to geographical distances, conflicting schedules, short notice, and other 
limitations. In such instances, viewers may watch a television program individually 
10 and then meet at a later time to discuss the program. However, if the viewers are 
unable to meet for an extended period of time, a discussion of the program may 
become stale. 

Alternatively, viewers may teleconference during a program (e.g., call 
one another on a telephone) for a more interactive discourse. Unfortunately, 

15 conventional teleconferencing presents a number of disadvantages. For example, 
extended teleconferencing during a broadcast may deprive other household 
members of the use of the telephone. Moreover, a telephone may not be easily 
accessible at the viewer's location, and relocating a telephone to the viewer's 
location may be difficult or inconvenient, particularly after a program has 

20 commenced. In addition, teleconferencing may be expensive, particularly where 
more than two parties are connected simultaneously. 

Moreover, teleconferencing during a television broadcast is 
problematic because the sound from the television may interfere with the viewer's 
voice so that the person with whom the viewer is teleconferencing may find it difficult 
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to understand the viewer. The extent of the interference may depend on a number 
of factors, including the volume of the television, the location of the television with 
respect to a microphone used for teleconferencing, the environment, and the like. 

Thus, it would be an advancement in the art to provide a convenient 
5 technique for conversing during a television broadcast with one or more other 
viewers at remote physical locations. It would be a further advancement in the art to 
provide a cost-effective system for conferencing which provides minimal disruption 
of the television program being viewed. In addition, it would be an advancement to 
provide systems and methods for reducing unwanted noise from the conversation, 
10 such as the sound of the television. 

BRIEF DESCRIPTION OF THE DFRAWINGS 
Non-exhaustive embodiments of the invention are described with 

reference to the figures, in which: 

15 FIG. 1 is a schematic block diagram of a system for providing 

television programming and communication services; 

FIG. 2 is an illustration of a hybrid communicator/remote control in the 
context of an interactive television system; 

FIG. 3 is a schematic block diagram of physical components of a set 

20 top box; 

FIG. 4 is a schematic block diagram of physical components of a 
remote control; 
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FIG. 5 is a schematic bloGl< diagram of logical components of a system 
for providing two-way communication using a hybrid communicator/remote control; 

FIG. 6 is an illustration of hybrid communicator/remote control 
displaying a graphical image of a contact's face; 

5 FIG. 7 is an illustration of an alternative embodiment of an interactive 

television system including a microphone and speaker Integrated with a set top box; 

FIG. 8 is a flowchart of a method for creating and using a contact list 
within a hybrid communicator/remote control; 

FIG. 9 is an illustration of a hybrid communicator/remote control and 
10 set top box in the context of teleconferencing using an interactive television system; 

FIG. 10 is a schematic block diagram of logical components of a 
system for canceling noise, including sound from a television, from captured audio 
input; 

FIG. 11 is a schematic block diagram of logical components of a 
15 system for canceling noise from captured audio input using an adaptive filter; 

FIG. 12 is a flowchart of a method for canceling noise from captured 

audio input; 

FIG. 13 is a schematic block diagram of logical components of a 
system for suppressing television sound during capture of audio input; 
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FIG. 14 is a schematic block diagram of logical components of an 
output suppression module for suppressing sound from a television during capture of 
audio input; and 

FIG. 15 is a flowchart of a method for suppressing television sound 
5 during capture of audio input. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention solves the foregoing problems and 
disadvantages by providing systems and methods for reducing noise during 
5 teleconferencing within an interactive television system. 

An interactive television system includes, in one embodiment, a hybrid 
communicator/remote control and a set top box. The hybrid communicator/remote 
control is configured to control various functions of the interactive television system, 
e.g., changing channels, adjusting the volume, etc. In addition, the hybrid 
10 communicator/remote control is configured to function as a communication device, 
with an integrated microphone, speaker, wireless receiver, and wireless transmitter. 

The set top box includes a wireless receiver for receiving 
transmissions from the wireless transmitter of the hybrid communicator/remote 
control. Moreover, the set top box is configured to establish a two-way 
15 communication channel with a remote user by means of a network, such as a 
broadband communication network, telephone network, satellite network, or the like. 

In one embodiment, the set top box includes a noise cancellation 
module to reduce unwanted noise, such as television sound, from audio input 
captured by the microphone of the hybrid communicator/remote control. The noise 
20 cancellation module may include an adaptive filter for noise cancellation, or may use 
other techniques known in the art. 
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In another embodiment, the set top box may include an output 
suppression module to eliminate television sound from a captured audio signal. In 
one configuration, the output suppression module suppresses all television sound 
while audio input is being captured by the hybrid communicator/remote control. 

5 As used herein, the term "contact" refers to a person to whom a caller 

may wish to communicate. A "contact list" refers to stored data relating to one or 
more contacts. An "address" identifies or locates a device capable of telephonic 
communication, such as a telephone, an interactive television system (including the 
described hybrid communicator/remote control), a wireless communication device 

10 (e.g., cellular phone), a computer including hardware and software for Internet- 
based telephony, or the like. Thus, the term "address" contemplates various types 
of network addresses, such as telephone numbers, IP addresses, URLs (Universal 
Resource Locators), MAC (Media Access Control) addresses, and the like. The 
term "visual identifier" may refer to any visual indication of the identity of a contact, 

15 including text, pictures, symbols, and the like. 

Reference throughout this specification to "one embodiment" or "an 
embodiment" means that a particular feature, structure, or characteristic described in 
connection with the embodiment is included in at least one embodiment of the 
present invention. Thus, appearances of the phrases "in one embodiment" or "in an 
20 embodiment" in various places throughout this specification are not necessarily all 
referring to the same embodiment. 
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Furthermore, the described features, structures, or characteristics may 
be combined in any suitable manner in one or more embodiments. In the following 
description, numerous specific details are provided, such as examples of 
programming, user selections, network transactions, database queries, database 
5 structures, etc., to provide a thorough understanding of embodiments of the 
invention. One skilled in the relevant art will recognize, however, that the invention 
can be practiced without one or more of the specific details, or with other methods, 
components, materials, etc. In other instances, well-known structures, materials, or 
operations are not shown or described in detail to avoid obscuring aspects of the 
10 invention. 

Throughout the following disclosure, the term "coupled" may be 
used to refer to components that are either directly connected to one another, 
indirectly connected to one another by one or more other components, or that the 
components may communicate through a wired or wireless connection either 
15 directly or indirectly. Thus, as used herein, the term "coupled" may be 

synonymous with "in electrical or electronic communication with" or simply "in 
communication with." 

Referring now to FiG. 1, there is shown a system 100 for providing 
television programming and communication services to a plurality of customers. In 
20 one implementation, the system 100 include is based on the infrastructure of 
broadband communication network 101, such as a cable network. However, other 
networks are contemplated, one particular example of which is a satellite network. 
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In one configuration, the system 100 includes a plurality of set top 
boxes (STBs) 102 located, for instance, at customer homes. Generally, an STB 102 
is a consumer electronics device that serves as a gateway between a customer's 
television 104 and the network 101. In alternative embodiments, an STB 102 may 
5 be embodied more generally as a personal computer (PC), an advanced television 
1 04 with built-in STB functionality, or another type of client terminal. 

An STB 102 receives encoded television signals and other information 
from the network 101 and decodes the same for display on the television 104 or 
other display device, such as a computer monitor, projection screen television, high- 
10 definition (HD) television, flat panel display, or the like. As its name Implies, an STB 
102 is typically located on top of, or in close proximity to, the television 104. The 
STB 102 may also send and receive video and/or audio signals for teleconferencing 
through use of the network 101 . 

Each STB 102 may be distinguished from other network components 
15 by a unique identifier, number, code, or address, examples of which include an IP 
(Internet Protocol) address or a MAC (Media Access Control) address. Thus, video 
and/or audio streams and other information may be transmitted from the network 
101 to a specific STB 102 by specifying the corresponding address, after which the 
network 101 routes the transmission to its destination using conventional 
20 techniques. 

As described more fully below, a hybrid communicator/remote control 
106 is provided, In one configuration, for convenient remote operation of the STB 
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102 and the television 104. Tlie hybrid communicator/remote control 106 may use 
infrared (IR), radio frequency (RF), or other wireless technologies to transmit control 
signals to the STB 102 and the television 104. Other remote control devices are 
also contemplated, such as a wired or wireless mice (not shown), PDAs, webpads, 
5 etc. 

In one embodiment, each STB 102 is coupled to a head-end 110 or 
other distribution node of the network 101. In the context of a cable network, a 
head-end 110 is generally a centrally-located facility within a community where 
television programming is received from a satellite downlink or other source and 

10 packaged together for transmission to customer homes. In one configuration, a 
head-end 110 also functions as a Central Office (CO) in the telephone industry, 
routing data streams to and from the various STBs 102 serviced thereby. Head- 
ends 110 may be coupled directly to one another or through the network 101. In 
alternative embodiments, head-ends 110 may be connected via a separate network, 

15 one particular example of which Is the Internet 112. 

The network 101 is preferably coupled to one or more television 
programming sources 114, which provide television programming for distribution to 
the STBs 102. In one configuration, television programs are distributed In an 
encoded format, such as MPEG (Moving Picture Experts Group). Various MPEG 
20 formats are known, such as MPEG-2, MPEG-4, MPEG-7, and the like. Thus, the 
term "MPEG," as used herein, contemplates all MPEG formats. Moreover, other 
video encoding/compression standards exist other than MPEG, such as JPEG, 
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JPEG-LS, H.261, and H.263. Accordingly, the invention should not be construed as 
being limited only to IVIPEG. 

The network 101 is also preferably coupled to the Internet 112 to 
provide access thereto by the STBs 102. The Internet 112 is a "network of 
5 networks" and is well known to those skilled in the art. Connmunication over the 
Internet 112 is accomplished using standard protocols, such as TCP/IP 
(Transmission Control Protocol/Internet protocol) and the like. 

As explained in greater detail below, the hybrid communicator/remote 
control 106 and/or the STB 102 may be equipped with a microphone and/or speaker 
10 to provide telephonic communication with one or more other parties. Video 
communication may also be carried out by, for example, providing a video camera 
within the hybrid communicator/remote control 106 and/or STB 102. 

A Central Office (CO) 120 for a telephone network 122 may be 
connected to any or all of the STBs 102, the head-ends 110, the broadband 
15 communication network 101, and the Internet 112. Multiple COs 120, and indeed, 
multiple telephone networks 122, may be connected to the STBs 102, head-ends 
110, the broadband communication network 101, or the Internet 112. 

The telephone network 122 may be embodied as a conventional public 
switched telephone network (PSTN), as known in the art. Standard telephones 130 
20 may be connected to the telephone network 122 via telephone lines. Additionally, 
desktop computers 132 with appropriate telephony circuitry may also be connected 
to the telephone network 122. 
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The telephone network 122 may be connected to a plurality of wireless 
devices via wireless transmitters 134 (such as cellular antennas). The wireless 
transmitters 134 may be in communication with various types of wireless devices, 
such as pagers 140, laptops 142, PDAs 144, and webpads 146. 

5 Furthermore, some devices may be connected to the Internet 112 

independent of the telephone network 122. For example, an Internet-accessible 
telephone 150, or "webphone," may be coupled via a high-speed connection (e.g., 
cable, DSL) to the Internet 112. Additionally, a computer 152 may be coupled to the 
Internet 112 by a similar connection. 

10 The embodiments disclosed herein provide a system and method 

whereby by which a user of a hybrid communicator/remote control 106 may rapidly 
and easily establish a two-way communication channel with any of the illustrated 
devices 106, 130, 132, 140, 142, 144, 146, 150, 152. Of course, the system 100 
illustrated in FIG. 1 is merely exemplary, and other types of devices and networks 

15 may be used within the scope of the invention. 

Referring now to FIG. 2, there is shown an interactive television 
system 200. As depicted, the system 200 may include an STB 102, a television 104 
(or other display device), and a hybrid communicator/remote control 106. 

The hybrid communicator/remote control 106 is provided for 
20 convenient remote operation of the STB 1 02 and the television 1 04 and may also be 
used for video and/or audio conferencing through use of the STB 102. In one 
configuration, the hybrid communicator/remote control 106 includes a wireless 
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transmitter 202 for communicating witli a corresponding wireless receiver 204 within 
the STB 102. Likewise, the hybrid communicator/remote control 106 includes a 
wireless receiver 204 for receiving signals from a wireless transmitter 202 within the 
STB 102. 

5 In one embodiment, the wireless transmitters 202 and receivers 204 

are configured to use radio frequency (RF) signals. In other embodiments, infrared 
(IR) or other frequencies along the electromagnetic spectrum may be used. 

The hybrid communicator/remote control 106 preferably includes a 
number of buttons or other similar controls for receiving user commands. For 

10 instance, the hybrid communicator/remote control 106 may include a power button 
206, an up arrow button 208, a down arrow button 210, a left arrow button 212, a 
right arrow button 214, a "Call" button 216, channel buttons 218, volume buttons 
220, alphanumeric buttons 224, and an "Add" button 226. Each of the alphanumeric 
buttons 224 may be associated with a set of alphabet characters 230 for entering 

15 text into the hybrid communicator/remote control 106 without an external keyboard. 
Various buttons and controls may have dedicated functions, while other buttons and 
controls may have multiple functions. The operation of certain of the above- 
described buttons and controls will be discussed In greater detail below. 

As depicted In FIG. 2, the hybrid communicator/remote control 106 
20 may include a speaker 242 for generating an audible output from an audio signal 
received through the wireless receiver 204. In addition, the hybrid 
communicator/remote control 106 may include a microphone 244 for capturing an 



13 



audio signal, which may be transmitted to the STB 102 by the wireless transmitter 
202. In certain embodiments, the hybrid communicator/remote control 106 may 
also include a digital video camera 245, such as a standard CCD digital video 
camera, for capturing a video signal for transmission to the STB 102. 

5 The various components of the hybrid communicator/remote control 

106 may be positioned in different locations for functionality and ergonomics. For 
example, as shown in FIG. 2, the speaker 242 may be positioned near the "top" of 
the hybrid communicator/remote control 106 (when viewed from the perspective of 
FIG. 2) and the microphone 244 may be positioned at the "bottom" of the hybrid 

10 communicator/remote control 106. Thus, in one embodiment, a user may 
conveniently position the speaker 242 near the user's ear and the microphone 244 
near the user's mouth in order to operate the hybrid communicator/remote control 
106 in the manner of a telephone. 

In alternative embodiments, the speaker 242 and the microphone 244 
15 may be integrated with the STB 102 and/or the television 104. Alternatively or in 
addition, the hybrid communicator/remote control 106 may include a headset jack 
260 configured to receive a standard headset plug 262 or the like. The headphone 
plug 262 may be connected to a hands-free headset 264 by a wire 266. The 
headset 264 may, for example, include one or two earphones 268 and a microphone 
20 270 mounted on a boom or other similar apparatus designed to position the 
microphone 270 near the user's mouth. Such a headset 264 may be used to reduce 
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audio interference from tine television 104 (improving audio quality) and to provide 
the convenience of hands-free operation. 

In one implementation, the wireless transmitter 202 of the hybrid 
communicator/remote control 106 is in electrical communication with the microphone 
244 and/or video camera 245 to receive a captured audio/video signal. The 
transmitter 202 preferably modulates the captured signal with a carrier frequency to 
enable transmission thereof to the STB 102 using techniques well known in the art. 
For example, the wireless transmitter 202 may operate according to the IEEE 
802.11a or 802.11b Wireless Networking standards, the "Bluetooth" standard, or 
according to other standard or proprietary wireless techniques. Modulation 
techniques may include spread spectrum, frequency shift keying, multiple carrier, or 
other techniques known in the art. 

To achieve modulation and transmission, the wireless transmitter 202 
may include various additional components not specifically illustrated but well known 
in the art. For example, the wireless transmitter 202 may include a source encoder 
for bandwidth reduction, a channel encoder for modulating the captured signal with a 
carrier signal, an amplifier, and a non-directional transmission antenna. The 
antenna may comprise a substantially two-dimensional metal structure formed on a 
printed circuit board for the hybrid communicator/remote control 106. 

Likewise, the wireless receiver 204 of the hybrid communicator/remote 
control 106 may further include components not specifically illustrated but well 
known in the art. For example, the wireless receiver 204 may include an antenna for 
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receiving a signal from the STB 102, an amplifier for increasing the strength of the 
received signal, and a decoder for separating and demodulating data from the 
carrier signal. 

In one embodiment, the wireless transmitter 202 and the wireless 
5 receiver 204 are configured to send and receive digitally-encoded signals. As such, 
the wireless transmitter 202 may include an analog-to-digital converter (ADC) for 
converting analog audio signals into digital signals. Likewise, the wireless receiver 
204 may Include a digital-to-analog converter (DAC) to convert digital signals into 
analog signals. Embodiments herein contemplate the use of either or both of analog 
10 and digital transmissions to and from the hybrid communicator/remote control 1 06. 

In the illustrated embodiment, the STB 102 includes a wireless receiver 
204 (similar to the one in the hybrid communicator/remote control 106) for receiving 
commands and audio/video signals from the hybrid communicator/remote control 
106. Similarly, the STB 102 may include a wireless transmitter 202 (similar to the 
15 one in the hybrid communicator/remote control 106) for sending audio/video signals 
and other data to the wireless receiver 204 in the hybrid communicator/remote 
control 106. 

The hybrid communicator/remote control 106 also preferably includes 
a display screen 250. The display screen 250 may be in electrical communication 
20 with the wireless receiver 204 to display a video signal received from the STB 102 
during videoconferencing. 
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The display screen 250 may be of any suitable type, but is preferably a 
liquid crystal display (LCD). If desired, the display screen 250 nnay be a backlit for 
enhanced picture quality and viewing in a dark environment. Additionally, the 
display screen 250 may be color or monochromatic in various embodiments. 

The display screen 250 is also preferably configured to display a 
contact list 252. In one embodiment, the contact list 252 includes one or more visual 
identifiers 254 of people with whom the user may communicate using the hybrid 
communicator/remote control 106. As depicted, the visual identifier 254 may be a 
name of the contact. Alternatively, as described in detail below, the visual identifier 
254 include a contact's picture, a symbol (e.g., icon), or the like. 

The contact list 252 may be entirely stored within the hybrid 
communicator/remote control 106. Alternatively, a user may "scroll" through a larger 
contact list 252 stored within the STB 102, with only a portion of the list 252 being 
retrieved and displayed by the hybrid communicator/remote control 106. 

The hybrid communicator/remote control 106 preferably includes a 
mechanism by which a visual identifier 254 of a contact from the contact list 252 may 
be selected by a user. For example, using the up and down arrow buttons 208, 210, 
a user may highlight or otherwise mark a visual identifier 254 of a desired contact, 
e.g., "Snoodle, Mortimer" in FIG, 2. 

Thereafter, as described in greater detail below, the user may be 
placed in communication with that individual by pressing the "Call" button 216 or the 
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like. In certain embodiments, the user may also terminate a call by pressing tlie 
"Call" button 216. 

The contact list 252 may also be displayed on the television 104 in a 
similar fashion. If desired, contact list 252 may be displayed on the television 104 in 
5 addition to, or in lieu of, a similar display on the display screen 250 integrated with 
the hybrid communicator/remote control 106. 

The "Add" button 226 is used. In one embodiment, to add new contacts 
to the contact list 252. As described in detail below, the user may press the "Add" 
button 226 to enter an manual entry mode in which the alphanumeric buttons 224 
10 may be pressed to enter a name and associated address for a new contact. As 
described previously, the address may be a telephone number, a network address 
for another interactive television system 200, an Internet address, or the like. The 
user may then press the "Add" button 226 to complete the addition of the new 
contact to the contact list 252. 

15 In alternative embodiments, the "Add" button 226 may be used to enter 

a contact selection mode in which the user may select a contact from a list (not 
shown), which may be may be retrieved from a remote telephone directory or 
contact list via the broadband communication network 101 or the Internet 112. For 
example, in response to activation of the "Add" button 226, a directory or contact list 

20 may be retrieved from the network 101 (via the STB 102) and displayed on the 
television 104 or display screen 250. Using the arrow buttons 208, 210, 212, 214, 
the user may highlight or othenwise mark a contact and press the "Add" button 226, 
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after which information for the contact is added to the contact list 252 of the hybrid 
communicator/remote control 106. 

Alternatively, the display screen 250 and/or television 104 may display 
a calling history including a list of contacts with whom the user has communicated 

5 via the hybrid communicator/remote control 106. In one embodiment, a user may 
select a contact from the calling history to add to the contact list 252 of the hybrid 
communicator/remote control 106 using the arrow buttons 208, 210, 212, 214 and 
the "Add" button 226. The telephone number or other address of the contact may be 
obtained by a caller Identification ("Caller ID") feature of the telephone network 122 

10 or an equivalent feature within an Internet-based telephone system. 

In yet another embodiment, the hybrid communicator/remote control 
106 may be configured to link electronically with an external electronic device to 
receive new contacts for the contact list 252. For example, the hybrid 
communicator/remote control 106 may be placed in communication with a PDA, a 
15 cellular telephone, a computer, or another hybrid communicator/remote control 106 
to receive one or more contacts, including the contact's address and visual identifier 
254 (e.g., name, picture, etc.). The communication may be accomplished using the 
wireless transmitter 202 and receiver 204 of the hybrid communicator/remote control 
106. 

20 While the following description refers primarily to a broadband cable 

network 101, the invention is not limited in this respect. A satellite delivery system 
may also be used, such as direct broadcast satellite (DBS) system. A DBS system 
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may include a small 18-inch satellite dish (which is an antenna for receiving a 
satellite broadcast signal); a digital integrated receiver/decoder (IRD), which 
separates each channel and decompresses and translates the digital signal for 
display by a television; and a remote control. 

5 Programming for a DBS system may be distributed, for example, by 

multiple high-power satellites in geosynchronous orbit, each with multiple 
transponders. Compression (e.g., MPEG) is used to increase the amount of 
programming that can be transmitted in the available bandwidth. 

A digital broadcast center may be used to gather programming 

10 content, ensure its digital quality, and transmit the signal up to the satellites. 

Programming may come to the broadcast center from content providers (TBS, HBO, 
CNN, ESPN, etc.) via satellite, fiber optic cable and/or special digital tape. Satellite- 
delivered programming is typically immediately digitized, encrypted and uplinked to 
the orbiting satellites. The satellites retransmit the signal to every earth-station ~ or, 

15 in other words, every compatible DBS system receiver dish at customers' homes 
and businesses. 

Some programs may be recorded on digital videotape in the broadcast 
center to be broadcast later. Before any recorded programs are viewed by 
customers, technicians may use post-production equipment to view and analyze 
20 each tape to ensure audio and video quality. Tapes may then be loaded into a 
robotic tape handling systems, and playback may be triggered by a computerized 
signal sent from a broadcast automation system. Back-up videotape playback 
equipment may ensure unintermpted transmission at all times. 
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While the following description makes particular reference to cable 
head-ends 1 10, it should be recognized that satellite broadcast centers may be used 
for the same purpose. Thus, as used herein, the term "broadcast center" may refer 
interchangeably to head-ends 1 10 or satellite broadcast centers. 

5 Referring now to FIG. 3, there is shown a physical block diagram of an 

STB 102. As noted above, the STB 102 includes a wireless receiver 204 for 
receiving control signals and audio/video signals from the wireless transmitter 202 in 
the hybrid communicator/remote control 106. Additionally, the STB 102 includes a 
wireless transmitter 202 for transmitting audio/video signals to the hybrid 

10 communicator/remote control 106. 

The STB 102 also includes, in one implementation, a network interface 
302 for communicating with the broadband communication network 101 via the 
head-end 110. The interface 302 may include conventional tuning, demodulating, 
and demultiplexing circuitry for receiving MPEG (Moving Picture Experts Group) 

15 packets corresponding to a selected MPEG channel. The interface 302 may also 
include conventional data modem circuitry for sending or receiving other types of 
data. For example, the interface 302 may conform to the DOCSIS (Data Over Cable 
Service Interface Specification) or DAVIC (Digital Audio-Visual Council) cable 
modem standards. In one embodiment, a CMTS-DRFI (Cable Modem Termination 

20 System-Downstream RF Interface) may be used in conjunction with a CMTS-URFI 
(Cable Modem Termination System-Downstream RF Interface) to establish two-way 
communication between the STB 102 and the head-end 110. 
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In one configuration, one or more frequency bands (for example, from 
5 to 30 IVIHz) may be reserved for upstream transmission. Digital modulation (for 
example, quadrature amplitude modulation or frequency shift keying) may be used 
to send digital signals in the upstream transmission. Of course, upstream 
5 transmission may be accomplished differently for different networks 101. Altemative 
ways to accomplish upstream transmission include using a back channel 
transmission, which is typically sent via an analog telephone line, ISDN, DSL, or 
other techniques. 

In an embodiment in which the STB 102 is connected directly to the 
10 CO 120, the STB 102 includes standard telephony circuitry 303. The telephony 
circuitry 303 may be used to dial a telephone number or receive incoming calls and 
establish a two-way telephone connection between the STB 102 and a device 130, 
132, 140, 142, 144, 146 connected to the telephone network 122. 

In one embodiment, the telephony circuitry 303 transforms an audio 
15 signal received by wireless receiver 204 of the STB 102 into a telephony-grade 
audio signal for transmission via the telephone network 122. Likewise, the 
telephony circuitry 303 may receive a telephony-grade audio signal from the 
telephone network 122 and generate an audio signal compatible with the wireless 
transmitter 202 of the STB 102 for transmission to a speaker 242 in the hybrid 
20 communicator/remote control 106, STB 102, or the television 104. Alternatively, or 
in addition, the telephony circuitry 303 may include analog or digital (e.g. DSL) 
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modem circuitry to allow audio, video, text, and control data to be transmitted to the 
devices 130, 132, 140, 142, 144, 146 via the telephone network 122. 

The STB 102 also preferably includes a CODEC (encoder/decoder) 
304. The CODEC 304 serves to encode signals (such as audio/video signals) into a 
5 network-compatible data stream for transmission over the network 101. The 
CODEC 304 also sen/es to decode a network-compatible data stream received from 
the network 101. As depicted, the CODEC 304 may be implemented as a hardware 
component. Alternatively, or in addition, software encoding and decoding may be 
used. The CODEC 304 may use various algorithms, such as MPEG, Voice over IP 
10 (VoIP), and the like, for encoding and decoding audio/video data. 

The STB 102 further includes a memory device 306, such as a random 
access memory (RAM), configured to store data for temporary use. Similarly, a 
read-only memory (ROM) may be provided for storing more permanent data, such 
as fixed code and configuration information. It will be appreciated by those skilled in 
15 the art that other types of memory may be used (e.g., PROM, EPROM, EEPROM, 
flash, etc.). 

In one embodiment, an audio/video (AA/) controller 308 is provided for 
converting decoded audio/video information into analog signals for display/playback 
on the television 104 or other device or devices. The AA/ controller 308 may be 
20 implemented using one or more physical devices, such as separate graphics and 
sound devices. In alternative embodiments, the AA/ controller 308 may provide a 
direct, digital video output for televisions 104 or other devices equipped to receive 
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the same. Preferably, the AN controller 308 includes graphics hardware for 
performing bit-block transfers (bit-blits) and other graphical operations in order to 
provide a graphical user interface (GUI) for display on the television 104. 

In some implementations, the STB 102 may include a storage device 
5 310, such as a hard disk drive or the like. The storage device 310 may be 
configured to record encoded television broadcasts and retrieve the broadcasts at a 
later time for decoding by the CODEC 304 and display by the AN controller 308. 

The storage device 310 may also be used in various embodiments to 
store viewer preferences, parental lock settings, electronic programming guide 
10 (EPG) data, programming preferences, passwords, e-mail messages, and the like. 
In one implementation, the storage device 310 also stores an operating system (OS) 
for the STB 1 02, such as Windows CE® or Linux®. 

A CPU 312 controls the operation of the STB 102, including the other 
components thereof, which are coupled to the CPU 312 via a bus 314. The CPU 

15 312 may be embodied as one of more microprocessors, a microcontrollers, digital 
signal processors (DSPs) or other devices known in the art. As noted above, the 
CPU 312 may perform logical and arithmetic operations based upon control signals 
generated by the hybrid communicator/remote control 106 and transmitted to the 
receiver 204. Alternatively, the CPU 312 may respond to control signals received 

20 through the network interface 302. 

As noted above, the STB 102 may include, in certain embodiments, a 
microphone 244, speaker 242, and/or video camera (not shown) for capturing and 
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reproducing audio and/or video signals. These components may be included in lieu 
of or in addition to similar components in the hybrid communicator/remote control 
106, and/or television 104. 

Of course, FIG. 3 illustrates only one possible configuration of an STB 
5 102, Those skilled in the art will recognize that various other architectures and 
components may be provided within the scope of the invention. In addition, various 
standard components of typical STB 102 are not illustrated in order to avoid 
obscuring aspects of the invention. 

Referring to FIG, 4, a schematic block diagram illustrates physical 
10 components of a hybrid communicator/remote control 106 according to an 
embodiment of the invention. The hybrid communicator/remote control 106 may 
include a bus 410 configured to transfer digital signals between the various 
components of the hybrid communicator/remote control 106. 

The hybrid communicator/remote control 106 may also include a read- 
15 only memory (ROM) 412 that contains data to be permanently stored within the 
hybrid communicator/remote control 106. For example, the ROM 412 may contain 
an operating system (OS) to control the operation of the hybrid 
communicator/remote control 106. The OS may be of a commonly available type, 
such as Windows CE® or Linux®. The ROM 412 may take the form of one or more 
20 programmable read-only memory (PROM) modules, electrically-erasable PROM 
(EEPROM) modules, or the like. 
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Additionally, the hybrid communicator/remote control 106 preferably 
includes a random access memory (RAM) 414 for storing temporary data. The RAM 
414 may store, for example, the contact list 252, user preferences, calling histories, 
visual identifiers, and/or verbal identifiers, as described more fully hereafter. 

5 Additionally, a CPU 416 may be provided to process instructions 

necessary for operation of the hybrid communicator/remote control 106. The CPU 
416 may be of any known type, such as a standard microprocessor, reduced 
instruction set computing (RISC) processor, field programmable gate array (FPGA), 
or application-specific integrated circuit (ASIC). The CPU performs 416 various 

10 logical and arithmetic operations based on instructions stored in the RAM 414 and 
ROM 412. 

A display controller 418 may be provided to control the operation of the 
display screen 250. As such, the display controller 418 may includes graphics 
hardware capable of transforming a display signal into a signal usable by the display 
15 screen 250 to produce visual output. The display controller 418 may be adapted to 
provide a monochromatic or color picture, as desired. 

An audio controller 430 is preferably connected to the microphone 244, 
the speaker 242, and, optionally, the headset jack 260. The audio controller 430 
may include an analog-to-digital converter (ADC), a digital-to-analog converter 
20 (DAC), compression-decompression hardware, or any other circuitry needed to 
receive and send audio signals via the microphone 244, speaker 242, and headset 
jack 260. 
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The user controls 206, 208, 210, 212, 214, 216. 218, 220, 224, and 
226 have been omitted from FIG. 4 for clarity, but can be utilized to control the 
operation of the various components of the hybrid communicator/remote control 106. 
Other components, such as a power supply, additional user controls, and the like 
5 may also be included, as known in to those skilled in the art. Operation of the 
various components of the hybrid communicator/remote control 106 and the set top 
box 102 will be described in greater detail in relation to FIGS. 5 and 6. 

FIG. 5 illustrates logical components of system 500 for providing a 
contact list 252 for a hybrid communicator/remote control 106. The depicted logical 

10 components may be implemented using one or more of the physical components 
shown in FIG. 3 and FIG. 4. Thus, while certain components may be depicted within 
the hybrid communicator/remote control 106, similar components may be embodied 
within the STB 102 in other embodiments. Likewise, components illustrated within 
the STB 102 may be embodied, in certain embodiments, within the hybrid 

15 communicator/remote control 106. Additionally, various logical components may be 
implemented as software or firmware. 

In one implementation, the system 500 includes a contact entry 
component 510 configured to permit a user to enter new contacts into the contact list 
252. Preferably, the contact entry component 510 provides various different 
20 mechanisms for contact entry. 

For example, the contact entry component 510 may include a manual 
entry component 512 configured to permit the user to directly input information for a 
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new contact into the list 252. As described previously, the user may utilize the 
alphanumeric buttons 224 of the hybrid communicator/remote control 106, with 
reference to the alphabet characters 230, to enter numbers or letters forming a 
name, address, and the like, for each new contact. In one embodiment, the user 
5 may activate the manual entry component 512 by pressing the "Add" button 226. 

The contact entry component 510 may also include a displayed list 
selection component 514 configured to permit the user to select a new contact from 
a directory or contact list being displayed by the television 104 or the display screen 
250 of the remote control 206. For example, the television 104 may display an 
10 online telephone directory, a technical support listing, an advertisement, a contact 
list, or the lil<e, retrieved from the broadband communication network 101, a 
computer, or hand-held device. The user may then choose a contact from the 
displayed list and press the "Add" button 226 in order to add the selected contact to 
the contact list 252. 

15 Additionally, the contact entry component 510 may include a 

past/present communication selection component 516 configured to permit a user to 
select a contact from a prior or present communication for entry into the contact list 
252. For example, a history of recent calls may be displayed on the television 104 
or the display screen 250 to show contacts with whom the user has communicated 

20 (or is presently communicating) over the interactive television system 200. A user 
may then select the desired contact from the list and press the "Add" button 226 to 
store information for the contact In the contact list 252. 
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Furthermore, the contact entry component 510 may include an external 
receipt component 518 configured to permit the user to receive one or more new 
contacts from an external device, such as a PDA, laptop computer, desktop 
computer, cellular phone, or another hybrid communicator/remote control 106. The 

5 hybrid communicator/remote control 106 may be configured to establish a 
communication channel with such devices using, for example, a wireless 
transmission method. A user may then select a desired contact stored in the 
external electronic device, for example, by highlighting the desired contact and 
pressing the "Add" button 226, to initiate a transfer of information related to the new 

10 contact to the hybrid communicator/remote control 106. 

Ultimately, the operation of the contact entry component 510 results in 
the addition of a new contact 520 to the contact list 252. As illustrated, a contact 
520 preferably includes an address 522. The address 522 may be a network 
location for another interactive television system 200 connected to the broadband 
15 communication network 101 , an IP or MAC address for a device available over the 
Internet 112, such as the devices 150, 152 of FIG. 1, or a conventional telephone 
number for a wired or wireless device available over the telephone network 122, 
such as the devices 130, 132, 140, 142, 144, 146. 

The address 522 need not correspond to a device with hardware 
20 capable of reproducing telephonic sound. For example, any of the devices 1 32, 140, 
142, 144, 146, 152 with a display screen may be configured to communicate with the 
contact via e-mail or interactive text-chat (e.g., instant messaging). In certain 
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embodiments, the interactive television system 200 or a computer within the 
broadband communication network 101 may be configured to convert verbal 
messages from the hybrid communicator/remote control 106 to text messages using 
standard techniques, and route the text messages to the device 132, 140, 142, 144, 
5 146, or 152 with the associated address 522. 

In one embodiment, a contact 520 within the list 252 also includes a 
visual identifier 524. As mentioned above, a visual identifier 524 is a visual 
representation of the identity of the contact. For example, a visual identifier 524 may 
be embodied as a contact's name or picture (as described more fully in relation to 
10 FIG. 7). The visual identifier 524 may also take the fomn of a symbol or icon (not 
shown) for identifying the contact, e.g., an iconic dollar sign may correspond to the 
user's stock broker or banker. 

In one embodiment, a contact 520 within the list 252 may include a 
verbal identifier 526. The verbal identifier 526 may include, for example, a digital 

15 audio sample of the contact's spoken name. As described below, the verbal 
identifier 526 may be used to allow a user to verbally select a contact 520 from the 
list 252. Alternatively, or in addition, the verbal identifier 526 may be reproduced by 
the speaker 242 when the corresponding contact 520 is selected or highlighted by a 
user. This may allow, for example, a visually impaired individual to easily select a 

20 contact 520 from the list 252. 

The verbal identifier 526 may be received by the hybrid 
communicator/remote control 106 using the components 514, 516, 518 described 



30 



above. In the alternative, the verbal identifier 526 may be obtained from the user via 
a verbal expression receiving component 527. The verbal expression receiving 
component 527 may be configured to receive a verbal expression, for example, 
through the microphone 244. 

5 After the verbal identifier 526 has been received, it may be digitized 

and associated with the contact 520. A verbal expression digitizing component 528 
may be configured to receive and digitize a verbal expression 538 using 
conventional digitization and compression techniques. 

The verbal identifier 526, along with the address 522, visual identifier 
10 524, and any other data relating to the new contact 520, may then be stored by a 
storage component 529 in the contact list 252. Various data structures may be 
used, such as an array, linked list, or other suitable data structure within the RAM 
414 or other memory device. 

As previously noted, the user may select a contact to call from the 
15 contact list 252 displayed on the display screen 250. Thus, the hybrid 
communicator/remote control 106 may be equipped with a display component 532 
configured to format and display the contact list 252 (or portion thereof) on the 
display screen 250. Preferably, the display component 532 may also be configured 
to permit a user to easily change which portion of the contact list 252 is displayed, if 
20 the contact list 252 is longer than can be conveniently displayed on the display 
screen 250. 
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In one embodiment, a user selection component 534 allows the user to 
select a contact 520 from the contact list 252 using the buttons 208, 210, 212, 214, 
216, 230 shown in FIG. 2. Once the user has selected a contact 520, the address 
522 corresponding to the selected contact is preferably obtained from the contact list 
5 252. 

As previously noted, the user, In one embodiment, may also select a 
contact verbally, if a verbal identifier 526 is available for that contact 520. More 
specifically, the verbal expression receiving component 527 and verbal expression 
digitizing component 528 may be activated to receive a verbal expression 538 from 
10 the user. 

The verbal expression 538 may be compared, through the use of a 
comparison component 539, with a verbal identifier 526 for each contact 520 stored 
in the contact list 252. The comparison component 539 may be configured, for 
example, to compare the wavelength, amplitude, tonal patterns, or other aspects of 
15 digitized sounds to determine whether the verbal expression 538 matches any of the 
verbal identifiers 526 within an acceptable degree of tolerance. If one of the verbal 
identifiers 526 matches the digitized verbal expression 538, the comparison 
component 539 may designate the contact 520 with the matching verbal identifier 
526 as the selected contact 520 and retrieve the corresponding address 522. 

20 The retrieved address 522 may be transmitted by a transmission 

component 540 to a reception component 541 within the STB 102 or another device 
that performs the function (e.g., an advanced television or the like, as noted 
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previously). After the address 522 is received, a two-way communication channel 
may be established in different ways, depending on what type of address was 
received. For example, if the address 522 corresponds to an address 542 on the 
broadband communication network 101, I.e., an interactive television system 
5 operated by another user, the STB 102 may take the steps necessary to initiate 
communication via the broadband communication network 101 through the use of a 
broadband network communication component 544. 

For example, the broadband communication component 544 may be 
configured to route the communication to the broadband communication network 
10 through one of the head-ends 110, to the broadband communication network 101, 
and then to an STB 102 of another interactive television system through the same 
head-end 110 or a different head-end 110, if the communicating parties do not use 
the same head-end 110. The CO 120, the telephone network 122, and the Internet 
112 need not be involved in the communication. 

15 If, however, the address 522 comprises an Internet address 546, such 

as an IP or MAC address, an Internet communication component 548 may be 
engaged to route the communication appropriately. The Internet communication 
component 548 may route the communication to an Internet-accessible device, such 
as the devices 150, 152 depicted in FIG. 1, through the head-end 110, the 

20 broadband communication network 101 , and the Internet 1 12. The Internet 112 may 
then route the communication appropriately through the use of its own internal 
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protocols. Communication with Internet-accessible devices may also be routed 
through the CO 120 for the telephone network 122. 

If the address 522 comprises an address 550 on the telephone 
network 122, i.e., a telephone number or the like, a telephone network 

5 communication component 552 may route the communication appropriately. The 
STB 102 may communicate with a device connected to the telephone network 122 
by a wired or wireless connection, such as the devices 130, 132, 140, 142, 144, 146 
by transmitting the communication directly from the STB 102 to the CO 120, and 
from the CO 120 to the telephone network 122. The telephone network 122, by its 

10 own internal processes, then routes the communication to the appropriate device. 

In alternative embodiments, the STB 102 may be configured to route 
all communication, regardless of the nature of the address 522, to a head-end 110 
or other intermediate node of the broadband communication network 101. 
Preferably, the head-end 110 or the other intermediate network node includes the 
15 communication components 544, 548, 552 necessary to ensure proper routing of the 
communication. 

FIG, 6 illustrates an alternative configuration of a displayed contact list 
252 in which a visual identifier 524 of a contact 520 Is a picture rather than name. 
The pictures may be digital photographs, drawings, or even icons associated with 
20 the contact. For example, the RAM 414 or the ROM 412 may contain a plurality of 
unassociated icons that the user can select to assign to certain contacts. 
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The display screen 250 may be configured to show only one of the 
picture-based visual identifiers 524 at a time or may show several simultaneously. 
The visual identifiers 524 may be arranged in alphabetical order of the contact's 
name, in chronological order of date/time of entry into the contact list 520, or may be 
5 arranged in a user-specified order. As depicted, the contact list 252 may display an 
indication of the relative position of the visual indicator 524 within the list 252. 

As with the embodiment of FIG. 2, the television 104 may work in 
conjunction with, or in some cases, instead of, the display screen 250 to provide the 
operation of the contact list 252. For example, the television 104 could be 
10 configured to show the pictures 752, If the pictures 752 are shown on the display 
screen 250, the screen 250 may advantageously be a color liquid crystal display 
(color LCD). 

Referring to FIG. 7, there is shown an alternative interactive television 
system 700 according to an embodiment of the invention. The interactive television 
15 system 700 may include an STB 702 configured to receive and process audio/video 
communication and a remote control 706 configured to permit selection of contacts 
from the contact list 252. 

More specifically, the STB 702 may include a built-in speaker 708 and 
microphone 710. The speaker 708 and microphone 710 may be configured 
20 somewhat differently than the speaker and microphone 242, 244 of FIG. 2, in that 
they may be specially designed to project and receive sound over greater distances 
with a comparatively small amount of interference and feedback. Thus, rather than 



35 



talking into the rennote control device, the user may simply talk from a location close 
enough to the STB 702 for the microphone 710 to capture the user's voice clearly. 

The STB 702 and the remote control 706 may also have wireless 
transmitters 712 and wireless receivers 714, which may be configured somewhat 

5 differently than the transmitters 202 and receivers 204 of FIG. 2. More specifically, 
the wireless transmitters 712 and the wireless receivers 714 of FIG. 7 need not 
transmit or receive a continuous audio/video stream, and may therefore be more 
simply constructed than the wireless transmitters 202 and the wireless receiver 204. 
For example, the wireless transmitter 712 and/or the wireless receiver 714 may be 

10 configured to use infrared (IR) frequencies. 

In addition or alternative to the speaker 708 and the microphone 710, 
the STB 702 may include a headset jack 760 configured to receive a plug 262 
connected to a headset 264, as previously described in connection with FIG. 2. 

The remote control 706 thus need not include a speaker and 
15 microphone, but may otherwise be configured in the same fashion as the hybrid 
communicator/remote control 106. The remote control 106 allows a user to select a 
contact from the contact list 252, after which a two-way communication channel may 
be established. If desired, the remote control 706 may have a microphone (not 
shown) to permit vocal selection of a contact from the contact list. 

20 Referring to FIG. 8, there is shown a flowchart of a method for creating 

and using the contact list 252 within the hybrid communicator/remote control 106. 
Initially, the hybrid communicator/remote control 106 may sense 802 user activation 
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of the "Add" button 226. Thereafter, a list of menu options for adding new contacts 
to the list may be displayed 804. The menu options may correspond with the 
various components 512, 514, 516, 518 of the contact entry component 510. For 
example, the display screen 250 may display text to query whether the user wishes 
5 to add the new contact by manual entry, selection from a displayed list, selection 
from past or present communication, or receipt from an external device. 

The hybrid communicator/remote control 106 may then receive 806 a 
user selection of a method for adding the new contact. The selection may be made 
through the use of one or more of the user controls 208, 210, 212, 214, 216, 230. 
10 After the selection has been received 806, the hybrid communicator/remote control 
106 may receive and store 808 the data 522, 524, 526 pertaining to the contact in 
the contact list 252. 

When a contact list 252 has been formed, the user can employ the 
contact list 252 to initiate communication with a contact, for example, by highlighting 
15 a desired contact and pressing the "Call" button 216. The hybrid 
communicator/remote control 106 may sense 810 user activation of the "Call" button 
and display 812 a portion of the contact list 252 on the display screen 250. 
Thereafter, the hybrid communicator/remote control 106 receives 814 the user 
selection of the contact. 

20 Next, the address 522 corresponding to the user selection may be 

transmitted 816 to the STB 102 to initiate the communication. The STB 102, or 
some suitable equivalent, may determine 818 the location of the address 522, i.e.. 
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whether the address 522 comprises an address 542 on the broadband 
communication network 101, an address 522 on the Internet 112, or an address 550 
on the telephone network 122. The STB 102 may then establish 820 a 
communication channel with the selected contact via the appropriate network, i.e., 
5 the broadband communication network 101, the Internet 112, or the telephone 
network 122. 

FIG. 9 illustrates an alternative embodiment of the invention in which 
an STB 902 is configured to substantially reduce unwanted acoustic noise from an 
audio input signal 904. In many cases, a near-end user 906 uses a hybrid 

10 communicator/remote control 106 in proximity to a television 104 to teleconference 
with a far-end user (not shown). The remote control 106 may capture both the TV 
sound 908 and the near-end user's voice 909. The sound 908 and the voice 909 are 
combined in the signal 904. The TV sound 908 interferes with the voice 909 thereby 
interfering with communication. The far-end user may have difficulty understanding 

15 the voice 909 of the near-end user 906 when the television sound 908 is sufficiently 
loud. Even when the television sound 908 is quieter than the user's voice 909, 
interference caused by the television sound 908 may be annoying to the far-end 
user. This may be particularly annoying when the far-end user is viewing the same 
television program and receives a slightly delayed TV sound 908. 

20 In one embodiment, the STB 902 may operate to cancel or 

substantially cancel the unwanted television sound 908 from the audio input 904 to 
provide a more intelligible audio/video conferencing experience for both users. As 
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shown, a user's voice 909 and television sound 908 may be simultaneously captured 
by the hybrid communicator/remote control 106 to create audio input 904. In one 
configuration, the STB 902 produces a filtered audio input signal 910 by subtracting 
the television sound 908 from the audio input 904. Thus, the far-end user will hear 
5 the voice signal 909 with the television sound 908 cancelled or substantially 
cancelled. 

Referring to FIG. 10, the STB 902 may include, in one configuration, a 
noise cancellation module 1002 for canceling unwanted noise (including the 
television sound 908) from the audio input 904 and produce filtered audio input 910. 
10 The filtered audio input 910 may then be transmitted to the far-end user during the 
course of two-way communication. 

The television sound 908 is produced when a television audio output 
signal 1004 is sent from the STB 902 to a speaker of the television 104. The 
television audio output signal 1004 is typically received through television 

15 programming as part of a broadcast signal. Various factors may affect the acoustic 
response of the environment to produce the television sound 908. For example, 
there may be echoes created in a particular room that include a time delay between 
outputting the television audio output 1004 and capturing the corresponding 
television sound 908 by the microphone 244 of the hybrid communicator/remote 

20 control 106. In addition, depending on the surfaces in the environment, more sound 
may be reflected or more sound may be absorbed. For example, when a room is 
substantially empty there may be more echo than when the particular room is full of 
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people. These and many other various factors affect the response of the 
environment which affects what television sound 908 will be captured by the 
microphone 244 when a particular television audio output 1004 is sent through the 
television 104. 

5 In one configuration, the television audio output 1004 is provided to the 

noise cancellation module 1002 in order to estimate the television sound 908. This 
estimate may then be used by the noise cancellation module 1002 to remove the 
television sound 908 component from the audio input 904 thereby providing a filtered 
audio input 910. 

10 Referring now to FIG. 11, those skilled in the art will appreciate that 

there are many systems and methods that may be used to cancel noise (e.g., the 
television sound 908) from the audio input 904. For example, an adaptive filter 1102 
may be implemented in software and executed on the CPU 312 or in hardware. 

It will be appreciated that other combinations of hardware and/or 
15 software may also be used for the same purpose. For example, a digital signal 
processor (not shown) may be included within the STB 902 for noise cancellation. In 
addition, analog systems and techniques may be used to achieve noise cancellation. 
In still other embodiments, a noise cancellation module 1002 may be implemented 
within the hybrid communicator/remote control 106. 

20 As illustrated in FIG. 1 1, the adaptive filter 11 02 receives the television 

audio output 1004 as an estimate of the noise signal (e.g., the television sound 908). 
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The adaptive filter 1102 tfien filters the estimated television sound 908 from the 
audio input signal 904 to produce the filtered audio input 910. 

In one embodiment, the noise cancellation module 1002 may include a 
training module 1 104. The purpose of the training module 1 104 is to provide a 
5 better estimate to the adaptive filter 1 1 02 than simply the television audio output 
1004. As noted above, various environmental factors affect how sound is received. 
Thus, the television audio output 1004 may not provide an adequate estimate for the 

television sound 908. 

In one embodiment, standard training techniques may be used by the 

10 noise cancellation module 1 002 to estimate the noise path and improve noise 

cancellation. The training module 1 104 may include a noise generator (not shown) 
to generate noise to be played on the television 104 for training the adaptive filter 
1 102. In one embodiment of the training module 1 104, the noise generator (not 
shown) may generate white noise to be played by the television 104 and received by 

15 the microphone 244 of the hybrid communicator/remote control 1 06 or received by 
the microphone 710 of the STB 902. The noise cancellation module 1002 may use 
the white noise captured by the microphone 244, 710 to train the adaptive filter 1 102 
for noise cancellation. The training time may vary, but in certain embodiments, the 
training continues until the effectiveness of the noise cancellation has been 

20 maximized or substantially maximized. 

In some cases, retraining may be required. Depending upon the 
difference between the acoustics of different rooms, or the position of the near-end 
user 906 in the room, the noise cancellation module 1002 may need to be retrained 
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for the new room or position. Retraining may be automatic (e.g., at periodic 
intervals) or user-initiated. 

Of course, it will be appreciated that the normal television audio output 
1004 being sent through the television 104 may also be used for training. An 
5 embodiment of the noise cancellation module 1002 may be designed to continually 
train and adapt to estimate the noise received by the microphone 244 of the hybrid 
communicator/remote control 106. Of course, a microphone 710 on the STB 702 or 
as part of an attached peripheral may also be used. 

Referring to FIG. 12, there is shown a flowchart of one method 1200 of 
10 operation of the STB 902 that includes the noise cancellation module 1002. Initially, 
the adaptive filter 1102 may be trained 1202 for acoustic noise cancellation. The 
training may continue 1204 until a satisfactory perfomiance by the noise cancellation 
module 1002 is achieved. 

The television audio output 1004 is provided 1206 to the adaptive filter 
15 1102 as an input. The adaptive filter 1102 uses the input to generate 1208 an 
estimate of the acoustic noise (e.g., the television sound 908) that will be present at 
the microphone input. Speech and acoustic noise, including the television sound 
908, are picked up 1210 (or captured) by the microphone 244, 710. The estimate of 
the acoustic noise is then subtracted 1212 from the audio input 904 captured by the 
20 microphone 244, 710. As a result, the filtered audio input 910 is available 1214 for 
transmission or for other use. If the noise cancellation module 1002 is still needed, 
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the adaptive filter 1102 may continue 1216 to operate to cancel noise from the input 
signal 904. 

Referring to FIG. 13, there is shown yet another alternative STB 1302 
including an output suppression module 1304. The output suppression module 1304 
5 may be used to suppress the television sound 908 or the television audio output 
1004 when audio input 904 including the near-end user's voice 909 is received by 
the STB 1302, e.g. via the wireless receiver 204 during two-way communication. 

As discussed above, the television sound 908 is related to the 
television audio output 1004 in that the television audio output 1004 is the signal or 

10 data sent to the television 1 04 for output to the user. The television sound 908 is the 
sound that is created by the television audio output 1004 being output and by the 
acoustic response characteristics of the environment. Those skilled in the art will 
appreciate that the sound of the television may be muted, attenuated, or blocked by 
either suppressing the television audio output 1004 before it gets to the television 

15 104 or by muting the television 104 speaker or audio system. Thus, as used herein, 
suppressing the television audio output 1004 and muting the television 104 or 
television audio system are used interchangeably herein and both refer to when no 
sound is output to produce any television sound 908. 

When audio input 904 that includes the near-end user's voice 909 is 
20 detected, the module 1304 effectively mutes the television 104 to reduce 
interference with capturing audio input 904. The muting of the television 104 may be 
stopped once capture of the audio input 904 including voice 909 is terminated, e.g., 
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after the communication is completed. Various methods and/or standard circuits 
may be used to reduce the volume of, or terminate, the television audio output 1004, 
which are well known to those skilled in the art. 

The output suppression module 1304 may be coupled to the wireless 
5 receiver 204 and/or the CPU 312 (not shown) in order to determine whether audio 
input 904 is being received by the hybrid communicator/remote control 106. For 
example, when a two-way audio connection is established, the CPU 312 may signal 
the output suppression module 1304 to suppress the television audio output 1004. 
Alternatively, the wireless receiver 204 may provide a signal to the output 
10 suppression module 1304 when audio input 904 is being received. In certain 
embodiments, the output suppression module 1304 may calculate averages over 
time of the audio input 904 to detect when audio input 904 that includes the user's 
voice 909 is being received. 

Figure 14 illustrates an embodiment of the output suppression module 
15 1304 that includes a voice detection unit 1402 and an output selector 1404. The 
voice detection unit 1402 takes as input the signal provided by the wireless receiver 
204. The voice detection unit 1402 processes this signal to determine whether voice 
909 or speech is present. If no voice 909 is detected, the voice detection unit 1402 
may cause the output selector 1404 to select the television audio output signal 1004 
20 to send to the television 104 for output. If voice 909 is detected, the voice detection 
unit 1402 may cause the output selector 1404 to send no signal or a muted signal to 
the television 1 04 for output. 
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In alternative embodiments, the output suppression module 1304 may 
be implemented within the remote control 106. In such an embodiment, the remote 
control 106 may send a wireless command, e.g., IR (Infrared) or RF (radio 
frequency), to the TV 104 to mute the volume when audio input 904 is being 
5 received or when a two-way audio connection is active. 

Referring now to FIG. 15, there is shown a flowchart of one possible 
method 1500 of operation of the STB 1302 that includes the output suppression 
module 1304. Initially, the voice detection unit 1402 may be trained 1502 or 
calibrated to detect when a user is speaking. The hybrid communicator/remote 

10 control 106 may include a button for calibration (not shown). The user 906 may 
push the calibration button (not shown) to indicate when he or she is speaking into 
the microphone 244, 710. Of course, it will be appreciated by those skilled in the art 
that the voice detection unit 1402 may also be operated without any training or 
calibration period. The training or calibration may continue 1504 as long as 

15 necessary. 

Audio input 904 is picked up 1506 or captured by the microphone 244, 
710. The audio input 904 is then provided 1508 as input to the voice detection unit 
1402. The voice detection unit 1402 processes 1510 the Input(s) to determine 
whether a voice 909 is present. If 1512 voice 909 is present, the audio output 1004 
20 to the television may be suppressed 514, or the television may be muted. If voice 
909 is not present, the output suppression module 1304 may continue to process 
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inputs waiting for user input. The output suppression module 1304 may operate until 
1516 it is no longer needed. 

Based on tine foregoing, the present invention offers numerous 
advantages not available in conventional approaches. For example, the present 
5 invention allows a user to teleconference with a far-end user through use of an 
interactive television system. The far-end user may be reached through television 
systems, computers and/or other devices connected to different networks, including 
a broadband communication network, a telephone network, and the Internet. 

Furthermore, systems and methods may be used to reduce unwanted 
10 noise from the audio signal being sent to the far-end user. The noise reduction may 
be accomplished through use of a noise cancellation module implemented within an 
interactive television system. Alternatively, the noise reduction may be achieved 
through use of an output suppression module. The noise reduction may result in a 
more pleasant teleconference for the users. 

15 While specific embodiments and applications of the present invention 

have been illustrated and described, it is to be understood that the invention is not 
limited to the precise configuration and components disclosed herein. Various 
modifications, changes, and variations which will be apparent to those skilled in the 
art may be made in the arrangement, operation, and details of the methods and 

20 systems of the present invention disclosed herein without departing from the spirit 
and scope of the invention. 
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